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Abstract. For a non-cooperative differential game, the value functions of the various players 
satisfy a system of Hamilton-Jacobi equations. In the present paper, we consider a class of infinite- 
ly ' horizon games with nonlinear costs exponentially discounted in time. By the analysis of the value 
\ functions, we establish the existence of Nash equilibrium solutions in feedback form and provide 
results and counterexamples on their uniqueness and stability. 

!: 

1 - Introduction 

> 

I Problems of optimal control, or zero-sum differential games, have been the topic of an extensive 

literature. In both cases, an effective tool for the analysis of optimal solutions is provided by 
the value function, which satisfies a scalar Hamilton-Jacobi equation. Typically, this first order 
P.D.E. is highly non-linear and solutions may not be smooth. However, thanks to a very effective 
I/"") ■ comparison principle, the existence and stability of solutions can be achieved in great generality 

by the theory of viscosity solutions, see [BC] and references therein. 
^ In comparison, much less is known about non-cooperative differential games. In a Nash equi- 

librium solution, the value functions for the various players now satisfy not a scalar but a system 
of Hamilton-Jacobi equations [F]. For this type of nonlinear systems, no general theorems on the 
existence or uniqueness of solutions are yet known. A major portion of the literature is concerned 
with games having linear dynamics and quadratic costs, see [WSE] , [EW] , [AF J] and [PMC]. In 
this case, solutions are sought among quadratic functions. This approach effectively reduces the 
P.D.E. problem to a finite dimensional O.D.E.. However, it does not provide insight on the stability 
(or instability) of the solutions w.r.t. small non-linear perturbations. 

In [BS1] the first author studied a class of non-cooperative games with general terminal pay- 
off, in one space dimension. Relying on recent advances in the theory of hyperbolic systems of 
conservation laws, some results on the existence and stability of Nash equilibrium solutions could 
be obtained. On the other hand, for games in several space dimensions and also in various one- 
dimensional cases, the analysis in [BS2] shows that the corresponding H-J system is not hyperbolic, 
hence ill posed. 

In the present paper we begin exploring a class of non-cooperative differential games in infinite 
time horizon, with exponentially discounted costs. In one space dimension, the corresponding value 
functions satisfy a time-independent system of implicit O.D.E's. Global solutions are sought within 
a class of absolutely continuous functions, imposing certain growth conditions as \x\ — > oo, and 
suitable admissibility conditions at points where the gradient u x has a jump. 
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The dynamics of our system is very elementary, and the cost functions that we consider are 
small perturbations of linear ones. However, already in this simple setting we find cases where 
the problem has unique solution, and cases where infinitely many solutions exist. This provides 
a glimpse of the extreme complexity of the problem, for general non-cooperative iV-player games 
with non-linear cost functions. 

The plan of the paper is as follows. In Section 2 we describe the differential game, introducing 
the basic notations and definitions. In Section 3 we prove that, from an admissible solution to the 
O.D.E. for the value function, one can always recover a Nash equilibrium solution to the differential 
game. The relevance of our admissibility conditions is then highlighted by two examples. 

The existence and uniqueness of global admissible solutions to the H-J system for the value 
functions is then studied in Sections 3 and 4. We first consider the cooperative case, where both 
players wish to move the state of the system in the same direction. In the case with terminal 
payoff, this situation was leading to a well-posed hyperbolic Cauchy problem [BS1]. As expected, 
in the infinite-horizon case we still obtain an existence and uniqueness result. Subsequently, we 
consider the case of conflicting interests, where the players wish to steer the system in opposite 
directions. In the case with terminal payoff, this situation leads to an ill-posed Cauchy problem, 
as shown in [BS2]. Somewhat surprisingly, we find that the corresponding infinite-horizon case can 
have unique or multiple solutions, depending on the values of certain parameters. 



2 - Basic definitions 

Consider an m-persons non-cooperative differential game, with dynamics 

m 

i = ^fi{x,a i ) 1 ai (t)eAi, xeM n . (2.1) 



i=i 



Here t i-> oti(t) is the control chosen by the i-th player, within a set of admissible control values 
Ai C M k . We will study the discounted, infinite horizon problem, where the game takes 
place on an infinite interval of time [0, oof, and each player has only a running cost, discounted 
exponentially in time. More precisely, for a given initial data 

x(0) = yeM n , (2.2) 

the goal of the i-th player is to minimize the functional 

Ji(a) = / e-*^i{x(t), Oi(t))dt, (2.3) 
Jo 

where t i-> x(t) is the trajectory of (2.1). By definition, an m-tuple of feedback strategies = 
a*(x), i = 1, ...,m, represents a Nash non-cooperative equilibrium solution for the differential 
game (2.1)-(2.2) if the following holds. For every i G {1, . . . , m}, the feedback control a, = a*(x) 
provides a solution to the the optimal control problem for the i-th player, 



min Ji(a) , (2.4) 
<*(•) 



where the dynamics of the system is 



x = fi(x,ai) + ^2fj(x,a*(x)), CYi(t)eAi. (2.5) 

3+i 
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More precisely, we require that, for every initial data y E iR, the Cauchy problem 

m 

x = J2f j (x,a* j (x)), x(0) = y, (2.6) 

3 = 1 

should have at least one Caratheodory solution t i-> x(t), defined for all t G [0, oo[ . Moreover, for 
every such solution and each % = 1, . . . , m, the cost to the i-th player should provide the minimum 
for the optimal control problem (2.4)-(2.5). We recall that a Caratheodory solution is an absolutely 
continuous function 1 1— > ar(i) which satisfies the differential equation in (2.6) at almost every t > 0. 

Nash equilibrium solutions in feedback form can be obtained by studying a related system of 
P.D.E's. Assume that a value function u(y) = (u\, . . . ,u n )(y) exists, so that Ui(y) represents the 
cost for the i-th player when the initial state of the system is x(0) = y and the strategies a*,... , a* m 
are implemented. By the theory of optimal control, see for example [BC], on regions where u is 
smooth, each component Ui should provide a solution to the corresponding scalar Hamilton- Jacobi- 
Bellman equation. The vector function u thus satisfies the stationary system of equations 

Ui(x) = Hi(x,Vu!,...,Vu m ), (2.7) 

where the Hamiltonian functions Hi are defined as follows. For each pj € M n , assume that there 
exists an optimal control value a*(x,pj) such that 

pj ■ fj (x, a* (x, pj)) + (x, a* (x, pj)) = mm { Pj ■ f) (x, a) + (x, a) } . (2.8) 

Then 

m 

Hi(x, Pi,...,p m ) =Pi -^2fj(x, a*{x,pj)) +tpi(x, a*(x,pi)) . (2.9) 

j=i 

A rich literature is currently available on optimal control problems and on viscosity solutions 
to the corresponding scalar H-J equations. However, little is yet known about non-cooperative 
differential games, apart from the linear-quadratic case. In this paper we begin a study of this 
class of differential games, with two players in one space dimension. Our main interest is in the 
existence, uniqueness and stability of Nash equilibrium solutions in feedback form. 

When x is a scalar variable, (2.7) reduces to a system of implicit O.D.E's: 

u i = Hi(x,u' 1 ,...,u' m ). (2.10) 

In general, this system will have infinitely many solutions. To single out a (hopefully unique) 
admissible solution, corresponding to a Nash equilibrium for the differential game, additional re- 
quirements must be imposed. These are of two types: 

(i) Asymptotic growth conditions as \x\ — > oo. 

(ii) Jump conditions, at points where the derivative u' is discontinuous. 
To fix the ideas, consider a game with the simple dynamics 

x(t) = «i(t) H \-a m (t) , 

and with cost functionals of the form 

/>oo 

Ma) = / e"* 
J o 
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(2.11) 



hi(x(t)) + ki(x(t)) 



a?* 



dt. 



(2.12) 



We shall assume that the functions hi , fcj are smooth and satisfy 

\K(x)\<C, ^<k t (x)<C, (2.13) 

for some constant C > 0. Notice that in this case (2.8) yields a* = —pi/ki, hence (2.10) becomes 



m v! 



Ui 



Erix \< + hi(x). (2.14) 



For a solution to the system of H-J equations (2.14), a natural set of admissibility conditions is 
formulated below. 

Definition 1. A function u : M i— > M m is called an admissible solution to the implicit system of 
O.D.E's (2.14) if the following holds. 

(Al) u is absolutely continuous. Its derivative u' satisfies the equations (2.14) at a.e. point x G M. 
(A2) u has sublinear growth at infinity. Namely, there exists a constant C such that, for all x G M, 

\u(x)\ < C (1 + \x\) . (2.15) 

(A3) At every point y £ M, the derivative u' admits right and left limits u'(y+), u'(y—). At points 
where u' is discontinuous, these limits satisfy the admissibility conditions 

Because of the assumption (2.13), the cost functions hi are globally Lipschitz continuous. 
It is thus natural to require that the value functions Ui be absolutely continuous, with sub-linear 
growth as x — > ±oo. Call pf = u'i(y±). By the equations (2.14) and the continuity of the functions 
Ui,hi,ki, one obtains the identities 

Recalling that the feedback controls are a* = —u'i/ki, the condition (2.16) now becomes clear: it 
states that x(y—) < < x(y+), i.e., trajectories should move away from a point of discontinuity. 
Notice that all of the above conditions are satisfied at a point y such that 

u >. (y-\-) 

]^-^<0, u' i (y+) + u' i (y-) = i = l,...,m. (2.18) 

By (Al), the derivatives pi = u[ are defined at a. e. point i G JR. The optimal feedback 
controls a* = —pi/ki are thus defined almost everywhere. We can use the further assumption (A3) 
and extend these functions to the whole real line by taking limits from the right: 

"•^-w- (2 ' 19) 
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In this way, all feedback control functions will be right-continuous. 

The system of implicit differential equations (2.14) is highly nonlinear and difficult to study 
in full generality. In this paper we initiate the analysis by looking at some significant cases. Our 
main results can be roughly summarized as follows: 

(i) If u = (ui,...u m ) provides an admissible solution to the system of Hamilton- Jacobi equa- 
tions (2.14), then the feedback strategies (2.19) provide a Nash equilibrium solution to the 
differential game (2.11)-(2.12). 

(ii) For games with two players, if the cost functions hi, hi are both monotone increasing (or both 
monotone decreasing), then (2.14) has a unique admissible solution. 

(iii) Still in the case of two players, one can give examples where the derivatives of the cost functions 
satisfy h\ + h' 2 = and infinitely many admissible solutions of (2.14) are found. On the other 
hand, if the sum h[ + h' 2 remains bounded away from zero, then under suitable assumptions 
the system (2.14) has a unique admissible solution. 



3 - Solutions of the differential game 

In this section we prove that admissible solutions to the H-J equations yield a solution to the 
differential game. Moreover, we give a couple of examples showing the relevance of the assumptions 
(A2) and (A3). 

Theorem 1. Consider the differential game (2.11)-(2.12), with the assumptions (2.13). Let 
u : iR I— ► M m be an admissible solution to the systems of H-J equations (2.14), so that the conditions 
(A1)-(A3) hold. Then the controls (2.19) provide a Nash equilibrium solution in feedback form. 

Proof. The theorem will be proved in several steps. 

1. First of all, setting 

g(x) = ^2 a *(x) 

i 

we need to prove that the Cauchy problem 

x(t) = g(x(t)) , 

has a globally defined solution, for every initial data y £ JR. This is not entirely obvious, because 
the function g may be discontinuous. We start by proving the local existence of solutions. 

CASE 1: g(y) = 0. In this trivial case x(t) = y is the required solution. 

CASE 2: g(y) > 0. By right continuity, we then have g(x) > for x € [y, y + 5], for some 8 > 0. 
This implies the existence of a (unique) strictly increasing solution x : [0, e] i-> M, for some e > 0. 

CASE 3: g(y) < 0. By the admissibility conditions (2.16), this implies that g is continuous and 
negative in a neighborhood of y. Therefore the Cauchy problem (3.2) admits a (unique) strictly 
decreasing solution x : [0, e] i-> M, for some s > 0. 
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E 



h{x) ' 



x(0) = y, 



(3.1) 



(3.2) 



2. Next, we prove that the local solution can be extended to all positive times. For this purpose, 
we need to rule out the possibility that \x(t)\ — > oo in finite time. We first observe that each 
trajectory is monotone, i.e., either non-increasing, or non-decreasing, for t £ [0, oof. To fix the 
ideas, let t i-> x(t) be strictly increasing, with x(t) — > oo as t — > T— . A contradiction is now 
obtained as follows. For each r > 0, using (2.14) we compute 

«i (*(*)) 



^(x(r))-^^(x(0)) = 

i 



(3.3) 



By assumptions, the functions and /i^ have sub-linear growth. Moreover, each fcj is uniformly 
positive and bounded above. Using the elementary inequality 



\x(t) - x(0)\ < 

from (3.3) we thus obtain 
\x(t) -x(0)| 2 



1 • \x(t)\dt < 



ldt 



1/2 



\x(t)\ dt 



1/2 



'Mt))f 



2ki(x(t)) 



dt 



< / \x(t)\ dt < 4C / 



<4c J2 u ^))-J2 U M°)) 

y i i 

< C (l + r){2+ \x(t)\ + |*(0)|}, 

for some constant Co- Therefore, either |x(r)| < 2 + 3|x(0)|, or else 

\x(t)\ < \x(0)\ + 2t-C (1 + t). 
In any case, blow-up cannot occur at any finite time T. 



f J2\ui(x(t))\dt+ [ J2\hi(x(t))\dt 
o Jo 



(3.4) 



3. To complete the proof, for each fixed i € {1, . . . , m}, we have to show that the feedback a* in 
(2.19) provides solution to the optimal control problem for the i-th player: 



mm 

«<(•) Jo 



hi(x(t)) + ki(x(t)) 



dt. 



(3.5) 
(3.6) 



where the system has dynamics 

X = Ctj + CXjjx) ■ 

Given an initial state x(0) = y, by the assumptions on u it follows that the feedback strategy 
ttj = a*(x) achieves a total cost given by Ui(y). Now consider any absolutely continuous trajectory 
t ^ x(t), with x(0) = y. Of course, this corresponds to the control 

ai (t) = x(t)-J2^(x) (3.7) 

3+i 
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implemented by the i-th player. We claim that the corresponding cost satisfies 

2" 



fV* hi(x(t)) + %(±(t) -5>i (*(*))) 





> Ui(y) . 



To prove (3.8), we first observe that (3.4) implies 

lim e -t Ui(cc(t)) = 

Hence 



i = 1, . . . ,n . 



u 



i (y)=U i (x(0))=-J - 



e t Ui 



(x(t)) 



dt. 



The inequality (3.8) can now be established by checking that 
Equivalently, letting aj be as in (3.7), 



< \ a i~ l^Y- ) Ui + ~2 ai + 



This is clearly true because, by (2.8), 



u'au'a 



Ui{x) = min I -^-a 2 + au • - ^ ^ + 



(3.8) 



hi{x(t)) + j(±(t) - 5>J (*(*))) 1 > e-*Ui{x(t)) - e-V { (x(t)) • x(t) . (3.9) 



□ 



We now give two examples showing that, if the growth assumptions (2.15) or if the jump 
conditions (2.16) are not satisfied, then the feedbacks (2.19) may not provide a Nash equilibrium 
solution. This situation is well known already in the context of control problem. 



Examples. Consider the game for two players, with dynamics 

x = «i + a 2 , 

and cost functionals 



(3.10) 



Ji 



dt. 



In this case, if u[ = Pi, the optimal control for the i-th player is 



7 



The system of H-J takes the simple form 

ui = - I — +u 2 J u lt 



u 2 



(»'. + tH 



(3.11) 



The obvious admissible solution is u\ = u 2 = 0, corresponding to identically zero controls, and 
zero cost. We now observe that the functions 

/ n f if |x| > 1, 

U1{X) = \-\(1-\X\) 2 if \x\<l, M*) = 0, 

provide a solution to (3.11), which is not admissible because the conditions (2.16) fail at x = 0. 
Next, the functions 

ui(x) = ~^x 2 , tt 2 (x) = 0, 

provide yet another another solution, which does not satisfy the growth conditions (2.15). 

In the above two cases, the corresponding feedbacks a*(x) = —u'^x) do not yield a solution 
to the differential game. 



4 - Cooperative situations 

We consider here a game for two players, with dynamics 

x = ai + a 2 , 

and cost functionals of the form 



Ji(a) 



hi(x(t)) + 



dt. 



Notice that, for any positive constants ki,k 2 ,X, the more general case 



J, 



(a)= / 
Jo 



-At 



hi{x(t)) 



2k; 



dt 



can be reduced to (4.2) by a linear change of variables. 

The system of H-J equations for the value functions now takes the form 

{u 1 {x) = h 1 {x)-u' 1 u' 2 -{u' 1 ) 2 /2, 
\ u 2 (x) = h 2 (x) - u x u 2 - (u' 2 ) 2 /2 , 

and the optimal feedback controls are given by 

a*(x) = -u'iix) . 
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(4.1) 



(4.2) 



(4.3) 



(4.4) 



Differentiating (4.3) and setting pi = v! i one obtains the system 

( h\ -pi = (pi + p 2 )p' 1 + P1P2 , 

I h' 2 -p 2 = P2P1 + (Pi + P2)p' 2 ■ 



(4.5) 



Set 



A(p)=( Pl+pa P l ), A(p) = det A(p) 

P2 Pi + P2 ' 



From (4.5) we deduce 



Notice that 



' pi = A(p)" 1 [ - pf + (^ - /i' 2 ) Pl + ^ 2 ] , 
p' 2 = A(p)" 1 [ - p\ + (/i' 2 - /ii)p2 + h' 2Pl ] . 



(4.6) 



^(p?+p|)< A(p)<2(pl+p 2 2 ). (4.7) 

In particular, A(p) > for all p = (pi,P2) 7^ (0, 0). Up to a rescaling of the independent variable, 
we can thus study the equivalent system 



P'l = (K ~ h' 2 ) Pl + h' lP2 - p\ 
p 2 = {h' 2 - h[)p2 + h' 2 pi - p\ 



(4.8) 



For piecewise smooth solutions, jumps are only allowed from any point (p 1 ,p 2 ) with 

p-+p->0 (4.9) 

to the symmetric point 

(pt,pt) = (-Pl, -Pa)- (4-10) 

Theorem 2. Let the cost functions hi,h 2 be smooth, and assume that their derivatives satisfy 

1 < K(x) < C (4.11) 

for some constant C > 1 and all x € M. Then the system (4-3) has an admissible solution. The 
corresponding functions a* in (4-4) provide a Nash equilibrium solution to the non-cooperative 
game. 

Proof. Write the O.D.E. (4.6) in the more compact form 

| = /(P). (4.12) 

To show the existence of at least one admissible solution of (4.3), for every u > 1 letpM : [-i/,oo[-» 
M 2 be the solution of the Cauchy problem 



/(p M ), P ( " ) H = (M). (4-13) 



dx 



It is easy to check that the polygon 



Ui{y) = / e 



-t 



r={(pi,P2); Pi,P2€[0,2C], Pi+p 2 >l/2C} 

is positively invariant for the flow of (4.6). Hence p^(x) G T for all v > 1 and x > —v. We can 
extend each function p^ to the whole real line by setting 

p(")(x) = (1,1) for x < -i/. 

By uniform boundedness and equicontinuity, the sequence admits a subsequence converging 
to a uniformly continuous function p : M i— > T. Clearly this limit function provides a continuous, 
globally bounded solution of (4.6). We then define the controls a*{x) = —pi(x) and the cost 
functions 

^(x(t,y)) + i(a*(x(t,y))) 2 dt , (4.14) 
where 1 i-> x(t, y) denotes the solution to the Cauchy problem 

x = a* ( x ) + «2 («) , x(0) = y. (4.15) 

This function provides a globally Lipschitz, smooth solution of the system (4.3). □ 

In the case where the oscillation of the derivatives h\ is sufficiently small, we can also prove 
the uniqueness of the Nash feedback solution. 

Theorem 3. Let the cost functions be smooth, with derivatives satisfying (4-11), for some constant 
C. Assume that the oscillation of their derivatives satisfies 

sup Mix) - titty)] < 6 i = 1,2 (4.16) 

x.y€R 

for some 5 > sufficiently small (depending only on C ). Then the admissible solution of the system 
(4-3) is unique. 

Before giving details of the proof, we sketch the main ideas. In the case of linear cost functions, 
where hA h\ = Ki, the phase portrait of the planar O.D.E. (4.8) is depicted in Figure 1. 

We observe that 

- Unbounded trajectories of (4.8), with \p(s) \ — > oo as s — > s, correspond to solutions p = p(x) 
of (4.6) with \p(x)\ — > oo, |p'(x)| — > oo as x — > ±oo. Indeed, because of the rescaling (4.7), as the 
parameter s approaches s finite limit s, we have \x\ — > oo. This yields a solution u(x) = f*p(x) dx 
which does not satisfy the growth restrictions (2.15). 

- The heteroclinic orbit, joining the origin with the point (ki, K2), corresponds to a trajectory of 
(4.16) defined on a half line, say [x, 00 [ . To prolong this solution for x < x one needs a trajectory of 
(4.16) which approaches the origin as s — > 00. But the two available solutions are both unbounded, 
hence not acceptable. 

- Finally, one must examine solutions whose gradient has one or more jumps, from a point 
P = with p\ + P2 > to its symmetric point — P = (—pi, —pi)- However, a direct 
inspection shows that, even allowing these jumps, one still cannot construct any new globally 
bounded trajectory. 
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Figure 1 



In the end, in linear case, one finds that the only admissible solution is (pi,P2) = (k>i,k 2 )- A 
perturbative argument shows that this conclusion remains valid if a small C 1 perturbation is added 
to the cost functions. 

Proof of Theorem 3. First Step. We begin with the case h'^x) = Kj and assume, without any 
loss of generality, that K\ < k 2 . 

Let p be a smooth solution of (4.8), as shown in Figure 1. 
We observe that the following facts hold (see Figure 2): 

1. Both sets A = {(pi,p 2 ) + (0,0) : Pl < , p 2 < 0} and {( Pl ,p 2 ) ^ (0,0) : P i > , p 2 > 0} 
are positively invariant for the flow of (4.8) and both B = {(pi,p 2 ) : pi > , p 2 < 0} and 
C = {(PI5P2) : Pi < , P2 > 0} are negatively invariant. 

2. If j5(s G ) G ^4 = {(pi,P2) 7^ (0,0) : p\ < , p 2 < 0} for some s a , then |p| — ► +00 as s +00. 
Indeed, since 

^(pi +^2) = -p1 -pI + kipi + K2P2 < -^(pi +P2) 2 < 0, 

we can assume there exist s > s Q and e > such that pi(s) +p 2 {s) < —e. Moreover, the following 
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holds for any a > s: 

^(Pi+P2)(<x) < ~\(pi(v) +P2{o)f < -\{Pi{s) +p 2 (s))(p 1 (a) +p 2 (v)) < |(p"i(<x) +P2{o))- 

Hence, an integration yields (p\ + p~2)(s) < —r\ei s for s > s (and r\ > 0) and (pi + p 2 ) — > — oo as 
s — > +00. 

3. If p(s ) £ B = {(pi,p 2 ) '■ Pi > , P2 < 0} for some s Q , then |p| — ► +00 as s — > —00. Indeed, 
let e > such that p\(s ) > e. Since 

-7-P1 = - Pi + ( K i ~ K 2)pi + < -(pi + n 2 - < , 

as 

it is sufficient to observe that, for a < s Q , 

^-Pi(a) < ~(pi(s ) + n 2 - Ki)p-i(a) < -(e + n 2 - Ki)pt(a) . 
as 

Hence, an integration yields Pi(s) > ^e"( e+K2 " Kl ' s for s < s (and r? > 0) and p\ — > +00 as 
s — > —00. 







c, 




D 


C— v 




K 2 -K, 


\ (K,,K,)\ 
\ F 




c 2 


E \ 












2K, 2K 2 




A 






B 



Figure 2 



4. If p(s G ) G Ci = {(^1,^2) : Pi < , p 2 > k-2 — «i} for some s OJ then — ► +00 as s — > —00. 
Here the argument is exactly the same as in the previous case with p 2 in place of p\ . 

5. If p(s a ) 6 C2 = {(pi,P2) : Pi < , < P2 < k 2 — Ki} then there exists s < s Q such that p(s) is 
in C\ as in case 4. above. Indeed there could be only two situations. 

If ~P\(s ) 2 + (ki — K 2 )p 1 (s Q ) + Kip 2 (s ) > 0, then, by negative invariance, p could only have reached 
this region from C\, hence there exists s < s Q such that p(s) is as in case 4 above. Otherwise, using 
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again negative invariance and the fact that there are no equilibria in C2 , either there exists s < s Q 
such that p{s) is in case 4 above, or there exists S\ < s a such that —pi(si) 2 + (k\ — K2)Pi( s i) + 
^1^2(^1) > and then, by the previous case, the existence of such a s < s\ < s a follows. 

6. If p(s a ) G D = {(pi,P2) ■ Pi > , p 2 > , p\ + p 2 > 2k 2 } for some s Q , then \p\ — »■ +00 as 
s — > —00. Indeed, since 



^(p"l + P2) = -Pi ~PI + «lPl + K 2 p2 < ~\{Pl +P2 - 2/C2)(Pl + P2) < 



(and the inequality is actually strict when pi + p 2 = 2k 2 ), we can assume that there exist s < s a 
and e > such that pi(s) +p2{s) > 2k 2 + e. Moreover, the following holds for any a < s: 

j- g {Pi +ih){p) < ~\{Pi{s) +P2{s) - 2K 2 )(pi(a) +p 2 ((r)) < -|(piO) +p 2 (v)) ■ 

Hence by integrating we find (pi +p 2 ){s) > rje~i s for s < s and r\ > 0. Therefore (pi +P2) — ► +00 
as s — > —00. 

7. If E E = {(pi,P2) 7^ (0, 0) : pi > , P2 > , p\ + P2 < 2«i} for some s G , then from 

J-(p"l +P2) = ~P\ -Pl + KlPl + K 2 P2 > + P2 - 2«i)(pi +p 2 ) > 0, 

it follows, as above, that either p — > for s — > —00 or there exists s < s such that satisfies 
one of the previous cases 3-4-5. 

8. If p(s ) G F = {(pi,P2) : Pi > , P2 > , 2«i < p\ + p 2 < 2/«2} for some s and p ^ p, then 
there exists a small circle V (say with radius smaller than \p(s a ) — p(s )\) around the stable focus 
p = («i, k 2 ) such that p £ V for s < s Q . But then, looking at the signs of the derivatives of pi, as 
s — > — 00 our solution j5 must go away from the whole region F and there exists s < s Q such that 
p(s) is in one of the previous cases. 




Figure 3a 



Figure 3b 



9. We can now provide more accurate estimates on blow-up. Indeed by previous analysis, blow-up 
of \p\ can only occur when either f>i —00 as s — » +00 or pi — > +00 as s — ► —00, for some index 
i G {1, 2}. To fix the ideas, assume \p\\ — > 00. Then for s sufficiently large 

— ^ + (/ci - K 2 )pi + Kip2 < . 
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Integrating the inequality -^pi < — ^r, one can conclude that \p\ —> oo as s — > s Q , for some finite 
s Q in both cases. In particular for this s a G M (and 77 > 0) p satisfies \p(s)\ > | . 

In terms of the original variable x, one may guess that the corresponding function p = p(x) 
could be as in Figure 3a and that u may be continued beyond the point where p blows-up (say 
x = x(s )). But this is not the case since such a trajectory yields a solution defined on the whole 
real line. Indeed by (4.7) 

= A()5(s))£ feV (4 ' 17) 

for some c Q > 0, and therefore either x(s) — » +00 as s ^ s Q — or x(s) — > —00 as s s Q +. 
Therefore, the solution u(x), corresponding to p(x), violates the growth assumptions (2.15) and is 
not admissible. 

10. We remark that in case 7, the solution p can tend to as s — > —00. But then for some c Q > 

\p\ <pi+p 2 < e c ° s . 
Recalling (4.7) we obtain, in terms of the variable x, 

= A(p(s))=0(l)-e 2c ° s , (4.18) 

lim x(s) = x a < 00 , 

S— > — OO 

for some x a G M. Therefore, to the entire trajectory s t— > there corresponds only a portion of 
the trajectory x 1— > i?(x), namely for x > rr . 

To prolong the solution -u for x < x D , we need to construct another trajectory s p(s) such 
that lim s ^ +00 p(s) = 0. But this trajectory, by previous analysis, will be unbounded, hence the 
corresponding u(x), will not be admissible. 

11. Next, we consider the case where p(s) is a discontinuous solution with admissible jumps. In this 
case, first of all we can say that p has no more than 2 jumps. Indeed the set Hi = {(pi,P2) '■ Pi < 
0, p\ + P2 < 0} is positively invariant and H 2 = {(^1,^2) : P2 < , p\ + P2 > 0} is negatively 
invariant. Hence if a jump occurs at s Q , either p(s Q +) G Hi or p(s — ) G H 2 . In the former case 
p(s) has no jumps for s > s Q ; in the latter case p has no jumps for s < s a . This means that there 
could be at most two jumps when there exist s\ < s 2 < S3 such that 

• a first jump occurs at Si and p(si-) G H 2 , 

• ;5 crosses the line p\ + P2 = at s 2 , 

• a last jump occurs at S3 and p{ss+) G Si. 

In any case, the corresponding solution u does not satisfy (2.15) and is not admissible. Indeed, we 
can have only three situations for a p with an admissible jump at s a : 

(a) if p{s — ) G H 2 , then \p\ — > 00 as s —>■ —00; 

(b) if p(s a +) G Si and pi(s a +) > 0, then either p(s) is continuous for s < s Q (and therefore 
\p\ — > 00 as s — > —00) or p has another jump at s such that p(s-) G S 2 (and therefore again 
\p\ — > 00 as s — > —00); 

(c) if p(s G +) G Si andpi(s +) < 0, then \p\ — > 00 as s — > +00. 

Second Step. We now extend the proof, in the presence of a sufficiently small perturbation. By 
(4.16), there exist constants ki,k 2 > such that 

\h[(x) - ki\ < S, \h' 2 (x) - k 2 \ < 5 forallxGiR. (4.19) 



dx 
ds 



dx 
ds 
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Let u(-) be the solution constructed in Theorem 2, and let u be any other smooth solution of 
(4.8). Call p = u', p = v! the corresponding gradients, rescaled as before, and let V be a small open 
bounded set containing the whole image of p and the point (/ci, k 2 ). Of course it is not restrictive 
to consider V as circular, say with radius p > 0. 

Now we split the proof in three cases. 

CASE 1: p(s) € V for every s. In this case we look at the difference w(s) = p(s) — p(s). We can 
write a linear evolution equation for w: 

^ = A(s)w(s), (4.20) 
where the matrix A is the "average" matrix 

A(s) = f Df(0p(s) + (1 - 6)p(s))M , (4.21) 
Jo 

and / is the vector field at (4.12). 

Since p,p € V, the matrix A(s) is very close to the Jacobian matrix Df(K\, k 2 ), therefore 

±\ w (s)\<-K\w(s)\, (4.22) 

for some constant K > 0. Indeed D/(ki,K2) is negative definite and, provided 8 (and then p) is 
small enough, A(s) is negative definite too. Hence 

2|tu(s)|-^-|u;(s)| = -^-\w(s)\ 2 = 2^-w{s) ■ w(s) = 2A(s)w(s) ■ w(s) < -2K\w(s)\ 2 . 

{JjO (Jjt5 (JjO 

Now integrating (4.22), we have for s < 0, 

2p> \w(s)\ > e~^ s |^(0) | 

and, letting s — > — oo, find 

U(0)| < lim \w{s)\e Ks < lim 2pe Ks = . (4.23) 

S— > — CO S— > — CO 

This implies p(0) = p(0), hence p = p by the uniqueness of the Cauchy problem. 



CASE 2: p{s ) £ V for some s a and, in particular, p(s ) in & small neighbourhood of the origin. 
Consider the linearized system near (0, 0) 

and notice that the origin is a saddle point for this system. Indeed H has eigenvalues Ai , A2 such 
that 

< ^ < = yJWtf + (h' 2 y - h[h> 2 < ^2Ci-±, (4.24) 

where C is the constant in (4.11). Moreover its eigenvectors v\, v 2 form angles ai, a 2 with the 
positive direction of the px-axis such that 
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Figure 4 




d 2 + — g - cN < |tanaj 



Aj + (/?-2 - ftj 



i) 



< C 



(4.25) 



where d = (C — -j) > and C is again from (4.11). 

Hence, exactly as one can do with saddle points in the autonomous case, we can prove that there 
exist four sectors Si, i = 1, ... ,4 (see Figure 4), where the following facts hold: 

(a) If p(s ) is in Si or S3, then \p(s)\ grows for s < s and the solution moves away from W; 

(b) Both boundaries of S2 and S4 allow orbits to only exit from those sectors for s < s Q ; 

(c) If p(s ) ^ Si for alH = 1, . . . ,4, then for s < s a the angle between the vector (pi,p2) and the 
Pi-axis is strictly monotone, forcing the solution either to reach Si or 53, or to move away from 



(d) Finally, if p{s a ) is in S2 or S4, then for s < s a the solution can tend to the origin. But, since 



as in the constant case, one obtains an estimate of exponential type of the decay of \p\. 

CASE 3: p(s Q ) £ V and p(s ) not in a neighbourhood of the origin. In this case, combining (4.19) 
and the continuous dependence of solutions with the estimates of the constant case (indeed, using 
(4.11), they remain true), we can prove that \p\ — > 00 for finite s and that the rate of blow-up of 
\p\ can be estimated in the same way we did in the case of = Kj. 



W; 



d_ 

ds 



(Pi +P2) = -Pi -pl + KPi + KP2 > -^{Pi+P2 ~ 2C)(pi +p 2 ) > 
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In any case either u = u or, in the original coordinates x, u fails to satisfy (2.15). 

It remains to prove what happens if u is an admissible solution with discontinuous (rescaled) 
gradient ft(s). Then assume ft has an admissible jump at s a . Using (4.19) it holds, for fti > 0, 

= -2ft\ + (h[ - h'^ftx < -2ft\ + (ki - k 2 + 28)ft x 

Pl+P2=0 

and hence, provided 8 small enough, the region Hi (resp. S 2 ) defined in the First Step is positively 
(resp. negatively) invariant also in this setting. Then conclusions made in the constant case still 
hold and u corresponding to ft is not admissible, since it violates (2.15). □ 



Ts {pl+p2] 



5 - Players with conflicting interests 

We consider here a game for two players, with dynamics (4.1) and cost functionals as in (4.2). 
Contrary to the previous section, we now assume that the player have conflicting interest. Namely, 
their running costs hi satisfy 

h[(x) < < h' 2 (x). (5.1) 

We begin with an example showing that in this case the H-J system can have infinitely many ad- 
missible solutions. Each of these determines a different Nash equilibrium solution to the differential 
game. 

Example 2. Consider the game (4.1)-(4.2), with 

hi{x) = — kx , /i 2 (x) = kx, (5.2) 

for some constant k > (see Figure 5). 

In this special case, the equations (4.8) reduce to 

f p[ = -2k Pi - Kp 2 -pf, 

[ P 2 = K Pl + 2k P2 ~ P 2 ■ 

The point P = (—k,k) is stationary for the flow of (5.3). Settinq q\ = pi + k, q 2 = p 2 — k, the 
local behavior of the system near P is described by 



= ~Kq 2 - q\ , 
= mi ~ <?2 • 

Notice that 

dp2 dq 2 q\ 

— = — = if qi = — , 
dpi dqi k 

dpi dqx q\ 
— = — = if q 2 = 

dp 2 dq 2 k 

dpi dqi 



(5.4) 



dp 2 dq 2 



if Pl = - P2 . 
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Figure 5 



By symmetry across the line p\ + p 2 = 0, any trajectory passing through a point P a = (—a, a) 
with < a < k is a closed orbit. We thus have infinitely many solutions of the H-J equations 
(5.3), having bounded, periodic gradients. Therefore, all of these solutions are globally Lipschitz 
continuous and satisfy the growth condition (2.15). Notice that the homoclinic orbit Ph(-) starting 
and ending at the origin also yields a periodic solution to the original equation (4.6). Indeed, to a 
solution p = p(s) of (5.3) with 

lim p(s) = lim p(s) = , 

S— > — OO S— S- + CO 

through the reparametrization x = x(s) there corresponds a solution p = p{x) defined on some 
bounded interval ]£ ,h [ • This yields a periodic solution p = p(x) with period £ = ii — £ Q . 

The main result of this section is concerned with the existence and uniqueness of admissible 
solutions. 

Theorem 4. Let any two constants ki,k 2 be given, with 

K\ < < K 2 , K\ + K 2 7^ . (5.5) 

Then there exists 5 > such that the following holds. If hi,h 2 are smooth functions whose 
derivatives satisfy 

\h[(x) — Ki\ < S, \h' 2 (x) — k 2 \ < 5 , (5.6) 
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for all x 6 M, then the system of H-J equations (4-3) has a unique admissible solution. 



Proof. We will first consider the linear case, where h\ = Ki is constant. Then we recover the more 
general case by a perturbation argument. 

Existence. Assume that hi(x) = Ki x with K\ + k 2 > 0, which is not rectrictive. The existence of 
an admissible solution for (4.8) is trivial, since we have the constant solution p = (k 1 ,k 2 ), which 
corresponds to 

K 2 K 2 
(lil(x), U 2 (x)) = (k X X + K X K 2 + y , K 2 X + K X K 2 + y) . (5.7) 

Consider now the case of h[, h 2 small perturbations of the constants ki,k 2 . Notice that, in the 
previous case, every ball B(n,R) around k = (ki, k 2 ) with radius R < -^(ki + k 2 ) was positively 
invariant for the flow of (4.8). 
Indeed, setting qi = pi — Ki, the system becomes 

f q [ = + K2 ) qi + Kl q 2 - q\ , 

1 ' ( JL ^ 2 ( 5 - 8 ) 

[q 2 = K 2 q x - (ki + K 2 )q 2 - q 2 . 

and it holds 
d \q\ 2 

^— = -g? - ^2 - ( K i + K 2)(ql + q\- ?i ga) = -{ql + ql~ ?iga)(Ki + k 2 + 91 + 92) • 

Now, since |g| < i? < + k 2 ) ensures ki + k 2 + 9i + 92 > 0, one can conclude that 

d \q\ 2 \q\ 2 

J- g — = ~(9i + 92 - 9i52) («i + «2 + 91 + 92) < — 2~(ki + k 2 + 91 + 92) < , (5.9) 

and this prove the positively invariance of such a ball B. 

Then, provided 5 is small enough, we can choose one of these balls as a neighborhood U of 
(k\,k 2 ) positively invariant also for the perturbed system (i.e. h[ ^ Ki). Once we found such a 
compact, positively invariant set U, we can repeat the existence proof of Theorem 2: 

a. Consider p^: [— u, oof— > iR 2 solution of the Cauchy problem with initial datum pM(-i/) = 

(«i,«2); 

b. By positive invariance, p(")(a:) G f7 for x > — z^. We then extend the function to the whole 
real line by setting p("\x) = (/ci, k 2 ) for ^ < — u; 

c. By uniform boundedness and equicontinuity, the sequence p^ admits a subsequence converg- 
ing to a uniformly continuous function p : iR t-> U. Clearly, this limit function p(-) provides a 
global, bounded solution to the system (4.8). In turn, this yields an admissible solution u(-) 
to (4.6). 

Uniqueness. First Step. Let h\ = Ki and K\ + k 2 > 0. In order to prove that the previously 
found solution is the only one that satisfies (Al)-(A3), we assume that u is another solution of the 
system (4.3), whose gradient will be denoted by p. Figure 6 depicts possible trajectories s h-> p(s) 
of the planar system (4.8). We remark that: 

1. The regions {( Pl ,p 2 ) + (0,0) : Pl > , p 2 < , Pl + p 2 < 0} and {( Pl ,p 2 ) ^ (0,0) : Pl > 
, p 2 < , pi +p 2 > 0} are positively and negatively invariant for the flow of (4.8), respectively. 
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Figure 6 



2. If p(s ) £ {(pi,P2) 7^ (0,0) : p\ > , p 2 < , pi + p 2 < 0} for some s G , then \p\ — > +oo as 
s — > +oo. Indeed, since 



d_ 

ds 



(Pi +P2) = -PI -P 2 + K lPl + K 2p2 < -(Pi +P2) < 0, 



we can assume there exist s > s a and e > such that pi(s) + p 2 (s) < —e. Moreover, for any a > s 
we have 



d_ 

ds 



(Pi+p2)(cr) < -(pi(<r) +p 2 (c r )) 2 < -(Pi(a) +P2(s))(pi(cr) + p 2 (cr)) < e(pi(<r) + j5 2 (<r)) • 



After an integration, we find (j?i +i?2)(s) < — ??e £S for s > s (and 77 > 0) and hence (p\ +P2) — > —00 
as s — > +00. 

3. If p(s ) G {(pi,]?2) 7^ (0,0) : pi > , p 2 < , pi + p 2 > 0} for some s a , then |p| — »■ +00 
as s — > —00. Indeed, reasoning as above, we can assume there exist s < s Q and e > such that 
Pi(s) + p 2 (s) > £ and the following holds for any a < s: 

-^(Pi + P2)(cr) < -iPiio) + p 2 {<j)) 2 < -(Pi(s) + p2(s))(pi((j) + p 2 (a)) < -eiptia) + p 2 (a)) . 

This implies (p\ +p 2 )(s) > i]e~ £S for s < s (and 77 > 0), hence (p\ + p 2 ) — > +00 as s — > —00. 
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4. If p(s ) G {(p\,P2) '■ Pi > 0, P2 > 0} for some s Q , then \p\ — > +oo as s ^ — oo. Indeed, let 
e > such that pi(s ) > £• Since 

T"Pi = ~Pi + ( K i - K 2)pi + Kip 2 < ~p\ < , 
as 

it is sufficient to observe that for a < s Q 

^Pi(o-) < -Pi{s )p 1 (a) < -epi(a) . 

Hence, integrating, pi(s) > r\e~ es for s < s (and r\ > 0) and either p t — > +cx) as s — > —00 or there 
exists s < s such that p is in the previous case. 

5. If p(s ) G {(pi,P2) : Pi < , pi < 0} for some s Q , then |p| — ► +00 as s — > +00. Here we can 
repeat the argument of 4. with p 2 in place of p\ . 

6. Let p(s ) G {(pi,P2) 7^ (0, 0) : pi < , ^2 > 0} for some s c and set p as the unique solution in 
this region that tends to the origin as s — > +00. Notice that, as s — > — 00, either p(s) crosses the 
P2-axis or pi — > +00. Then: 

• if p = p, then as stated above either there exists s < s a such that p(s) is in the case 4, or 
p 2 — > 00 as s — > —00. In both cases |j5| 00 as s — > —00. 

• if j5(s ) belongs to the region between p and the ^2-axis, then there could be only three 
possibilities: either p is the unique solution that tends to the origin as s — > —00, or p 2 — > 00 
as s — + — 00 without p crosses ^2-axis (and, of course, this can only happen if p does not cross 
it too), or there exists s < s a such that p(s) is in the case 4. above. In the former case we 
will estimate the decay of \p\ in 8; in the latter ones \p\ — > 00 as s — > —00. 

• if p(s a ) doesn't belong to the region between p and the £>2-axis, then either p 2 — > 00 as s — > —00 
or there exists s < s Q such that p(s) is in case 5 above (and this is possible only if also p(s) 
crosses the p2-axis). In both situations, again, \p\ — > 00 as s — > —00. 

7. We can now provide more accurate estimates on the blow-up rate. Indeed by previous analysis, 
as in Theorem 3, a blow-up of \p\ can only occur when either pi — > —00 as s — > +00 or pi — > +cx) 
as s — > —00 (for some index i). Hence, exactly as before, we can prove that there exists s a 6 M 
(and T) > 0) such that |p(s)| > s _^ s | . In terms of the original variable x, such a trajectory yields 
a solution defined on the whole real line, because by (4.7) 

= A «^(^p- <5 - 10) 

for some c c > and therefore either x(s) — > +00 as s — > s D — or x(s) — > —00 as s — > In 
conclusion, the solution -u(x) which corresponds to p(x) violates the growth condition (2.15), and 
hence it is not admissible. 

8. Notice that only in case 6-(ii), where p is the unique solution that tends to as s — > —00, we 
have a solution that could remain bounded in the whole JR. But in this case, we shall have as 

s — > — 00 

\p\(s)< (P2-Pi)(s)< 7 e c ° s , (5.11) 
for some 7, c Q > 0. Indeed studying the linearized system near the origin we see that p tends to 
(0,0) along the direction (1, K2 K i+v / *-i+ K 2 Then there exists s such that for s < s the 



dx 
ds 
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following holds: 



~ , s , ^2 K 2 ~ Ki . K 2 - «1 + -v/ K l + K 2 = K 1^2 - , , 

P2(a) > (1 + -=-) = /9 Pi(s) , 



where 



(l + ^)(K2-«i) 



- Kl + + K 2 _ 



«2 



/3G (0,1). 



(5.12) 



(5.13) 



Notice that, setting 



m - 2k 2 



2«i)/?- 



1-/3 



K2-Kl+\/K[+K2-KlK2 



Ki - 2k 2 - (« 2 - 2/d)(l + ^)^^ 



(5.14) 



>0, 



we obtain exactly 



Hence, for s < s, 







«2 



— K\ + + «| ~~ K 1^2 ^1 — 2k 2 



P2(S) > 



K\ k 2 — 2k\ — a 

K\ — 2k 2 — a 



k 2 — 2k\ — a 



Pi(s) , 



(5.15) 



(5.16) 



i.e. (k 2 — 2ni)p 2 — (ki — 2n 2 )p\ > oi(p 2 — pi). Recalling that \p\ — > as s — > — oo, which implies 
the existence of c Q > and s such that a — Pi(s) — p 2 (s) > c a for any s < s, we find 



d_ 

ds 



ip2 ~Pi) =P\-p 2 + («2 - 2ki)^2 - («i - 2k 2 )pi > (a- Pi -P2){P2 - Pi) > c (p 2 -px) , 



for s small enough (namely s < min{s,s}). Integrating we find (p 2 — Pi)(s) < je CoS (7 > 0) and 
hence (5.11) is proved. Next, recalling (4.7), in terms of the variable x we obtain 



dx 



ds 



A(p(s))=0(l)-e 



lim x(s) = x < 00 , 



2c c s 



(5.17) 



s— > — 00 



for some x Q € Si. Therefore, to the entire trajectory s 1— > p(s), there corresponds only a portion 
of the trajectory x 1— > p(x), namely the values for x > x D . To extend this trajectory also on the 
half line ] — 00, x a ], we need to construct another trajectory s with lim s ^ +00 p(s) = 0. But 

any such trajectory, by previous analysis, will yield a solution u(x), which violates the sublinear 
growth condition (2.15) as x — > —00 and is not admissible. 



Second Step. Next, we prove uniqueness of the admissible solution the case where h\ is not constant. 
Let u(-) be the solution constructed before, with p = v! remaining in a small disc V, centered at 
(ki,k 2 ) with radius p > 0, positively invariant for the flow of (4.8). Moreover, let u be any other 
smooth solution of (4.3). We split the proof in three cases. 
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CASE 1: p(s) 6 V for every s. In this case, as in Theorem 3, we look at the difference w(s) = 
p(s) — p(s) and at the linear evolution equation for w: 

^ = A(s)w(s), (5.18) 

where A is the averaged matrix 

A(s) = f Df(0p(s) + (1 - 8)p(s))d9 , (5.19) 
J o 

and / is the vector field describing our system, as in (4.12). Since p,p £ V, the matrix A(s) is very 
close to the Jacobian matrix Df(K\, k 2 ), therefore 

±\ W ( S )\<-K\w(s)\, (5.20) 

for some constant K > 0. Indeed, 

Df(K U K 2 )x-x <- Kl+ 2 K2 \x\ 2 . (5.21) 

Provided that S, p > are small enough, there will exist K > such that A(s)x ■ x < — K\x\ 2 . But 
then, exactly as in Theorem 3, (5.20) implies p(0) = p(0) and hence p = p by the uniqueness of 
the Cauchy problem. 

CASE 2: p(s a ) £ V for some s Q and, in particular, p(s Q ) in a small neighborhood W of the origin. 
Consider the linearized system 

p'i \ _ H . (pi \ H _ ( K - h 2 K 



P ' 2 J \ P2 ) ' V h> 2 K-h'J ' 

and notice that the origin is again a saddle point for this system. Indeed H has eigenvalues Ai , A2 
such that, recalling (5.6) and provided 5 < ^ min{— /ci, k 2 }, 

< ^(k 2 - «i - 2(5) < |Ai| = ^/(/I'i) 2 + (h' 2 ) 2 - h[h' 2 <k 2 - Ki + 25. (5.22) 

Moreover its eigenvectors v\ , v 2 form angles «i , a 2 with the positive direction of the pi-axis such 
that 

Al + {h > h >) \ 2 + (h' 2 -h' l ) 

> tan a\ = -f — > tan a 2 = -f — . 

h\ h\ 

More precisely, for 8 small enough, we have 

1/2, k 2 - ki + 25 , \/2. k 2 — K\ — 2(5 
> tanai > (1 - ^— ) — — > (1 + ^— ) — — > tana 2 . (5.23) 

2 K\ + 2 Ki — 

Hence, as in the previous proof of Theorem 3, we show the existence of four sectors Si, i = 1, . . . , 4 
(see Figure 7), where the following holds: 

(a) If p(s ) is in Si or 53, then \p(s)\ grows for s < s and the solution moves away from W; 
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Figure 7 



(b) Both boundaries of S2 and S4 allow orbits to only exit from those sectors for s < s a ; 

(c) If p(s Q ) ^ Si for alH = 1, . . . , 4, then for s < s D the angle between the vector (pi,p~2) and the 
Pi-axis is strictly monotone, forcing the solution either to reach S\ or S3, or to move away from 
W; 

(d) Finally, if p(s ) is in S2 or £4, then for s < s a the solution can tend to the origin. But 

^- s (p2 ~ Pi) =p\-pl + (K - 2h' 1 )p 2 - (h[ - 2h' 2 )p 1 > 

> Pi ~ Pi + («2 - 2/ci - 35)p 2 - («i - 2k 2 - 35)pi , 
and, provided 5 is small enough, we can use (5.23) to find a > such that 

- Pi) > Pi -pl + ( K 2 - 2ki - 3(5)p 2 - («i - 2k 2 - 35)pi > (a-pi - p2)(p2 - Pi) ■ (5.24) 

Hence an estimate of exponential type of the decay of \p\ follows as in (5.11). 

CASE 3: p(s ) £ V and p(s ) not in a neighbourhood of the origin. In this case, combining (5.6) 
and the continuous dependence of solutions with the estimates of the constant case (indeed they 
are true also in this more general setting), we can prove that \p\ — ► 00 for finite s and that the rate 
of blow-up of |p| can be estimated in the same way we did in the First Step. 

In any case either u = u or, in the original coordinates x, u fails to satisfy (2.15). 

Finally, we rule out the possibility that the gradient p = u' has jumps. Looking at the phase 
portrait in Figure 6, we see that after a one or at most two admissible jump, the values of p must 
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fall within the positively invariant region {(^1,^2) : Vi < , p\ + P2 < 0}. It follows that p 
cannot have any more jumps, and the estimates in 2, 5 and 7 (together with their analogs in the 
non-constant case) imply that u(x) violates (2.15) as x — > +00. Therefore, u is not an admissible 
solution. □ 
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